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INTRODUCTION 
Discussion of the Problem 


Within the last two years, considerable attention has 
been focused on the problem of "cost overrun" or "cost under- 
Sotsmacion, in Department of Defense expenditures, 993i 
particular, this notoriety has centered on the advancing 
price tags attached to certain weapons Systems and programs, 
In the past several years, enormous overruns ranging from 
300 to J0O00 percent have occurred, } This illustrates the 
problem. Specifically, the tendency in calculating weapons 
systems costs has been to underestimate. 

Probably the Loudest congressional outery resulted 
from the Air Force contract with Lockheed Aircraft Corporation 
for procurement of the giant C-5A transport, Senator William 
Proxmire and the Joint Subcommittee on Economy in Government, 
pointed out that the projected costs of the entire contract 


; 


package have risen from $3,4 to $5.3 billion dollars, 
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1 John H, Rukel, "Research and Development Contracting, 
Polic#®es and Problems," in Research and Development Contracting , 


(Washington, D.C.: Federal Publications Inc,, i963), p. 23 





2uThe Inflated Case of the C-5A," Armed Forces 
Management, July 1969, P, /] 








Cost overrun is not just a problem of recent years, 
Historically, it is worth noting that funding problems had 
their roots in times preceeding the first United States 
Naval Fleet, On March 27, 1794, Congress authorized the 
building of six frigates at a total cost of $688,888.32. 
The problems incident to the construction of these frigates 
were numerous, and not unlike the problems we encounter 
in weapons system acquisition today, It was intended that 
the six frigates would b2 afloat in 1/95, However, the 
Secretary of War's report to the House of Representatives 
in 1/94, concerning the progress on the construction of the 
Biips, told of late delivery. in his report, he noted, 

That everything, if not to. be created, must be 

modified, Tne wood of which the frames are to be 

mada is Standing in the forest; the iron for the 

cannon lying in its natural bed; and the flax and 

hemp pernaps in their seed, 

| It scon became apparent that only enough live oak 
could be delivered to sustain construction of two frigates, 
Construction had to be suspended on the remaining ships, 
Seurces of supply were few and far between, Funds were 
reprogrammed to cover excess costs over the original 
estimates, The actual cost came to $926,267.55 for just 


three frigates, when cix had been estimated to cost 


$688 ,8&8,32, As a result, there was a Congressional 








inquiry into the "apparently enormous" cost of building 
three frigates, } 

In moze recent times, the Department of Defense 
acknowledged in December 1969, that the projected cost 
overruns on 35 major weapons systems amount to nearly 
$20 billion, The average growth in costs among these 
systems cited was approximately 2/ percent against a base- 
line estimate of $/74 billion, Table 1] lists eight selected 
weapons systems and compares the base-line cost estimates 
with the current estimates, The total cost overrun is 
expressed aS a pexcentage of the base, 

Defense managers are worried about the size of 
Specific overruns, For example, the total overrun may 
amount to as much as 395 percent in the case of the Westing- 
house Mark 48 toxpedo, A June 1964 estimate amounted to 
$655 million, The total estimated cost is now $2.8 billion. 2 

In two Navy programs, the DD-963 destroyer and the 
DAGN nuclear frigate, the actual contracting state has not 
yet been reached and the costs have risen $1.7 billion and 
$1.5 billion respectively, Inflation has been cited as the 
prime cause for the rise in costs, Whether or not inflation 


is really the reason remains to be seen, 
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loommander, Naval Supply Systems Command, "Did you 
Know," Navy Supply Corps Newsletter, March 19/70, p. 7/0 


: AWraking ties Petenscive Om bien Arms Costs ," 
Business Week, Decembor 6, 1969, p., /0 
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F-l1]1 Fighter Bomber $3 7a 

Mark 48 Torpedo _ 655 3,241) 394.8 
DD-963 Destroyer ne ois: 3a? 7. Gone 
F-15 Fighter 6,039 7,700 27.5 
C-5A Transport 3,413 5,004 46,6 
DXGN Nuclear Frigate isso SOLS 46,2 
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SRAM Missle 
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1,470 249.2 
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Source: "Taking the Defensive on High Arms Costs," 
Business Week, December 1969, p. 7/0 





The foregoing examples of cost overrun are not 
isolated or unusual cases, The cases cited in Table 1] are 
selected to highlight certain programs where costs have 
exceeded the original estimates by more than $1 billion. 

This discussion establishes that a severe problem 
exists, and that it is more widespread than was commonly 
Supposed. From the record of major systems costs, it mignt 
be inferred that this problem is extended to the lesser 
Peosrams wnich, for one reason or another, do not find them- 


selves under critical scrutiny from Congress and the public, 
Discussion of Specific Aspects of the Problem 


Acquisition of a weapons system is not to be com- 
pared to the puschase of an automobile, The latter dmplaee 
emeLtxea,; or nearly fixed cost. Procurement of a weapons 
system is preceeded by researcn, development, test and 
evaluation, In each stage there exists an element of 
uncertainty. This uncertainty may take the form of tech- 
nological requirements, performance specifications, time, 
labor and materials availability, or production capacity. 
Meen wuncertainty, when related to cost, tends to produce an 


upward effect on final costs, In other words, the government 


does not Simply purchase a system at some stated cost. 








The introduction of any uncertainty, generally requires 
a prediction, In systems acquisition, the heart of the problem 
1S the adequacy of cost prediction, The inference is that a 
faulty or inadequate estimate of the program costs tend to 
result in cost overrun, The elements of the problem are the 
Specific uncertainties or factors that contribute in some way 
to the overall Situation, 


A review of the Departrent of Defense record of cost 


estimation during the fifties, indicates en apparent bias 
toward underestimation, | The degree of underestimation and 
the variance of estimation error, seem to be related to the 


earliness of the estimate, and also. the type of program ine- 


y 


toad 


volved, Differences between early estimates and final costs 
have been smaller for systems where attempted technical advances 
were modest, These included non-combatant ships, and cargo 
aircraft, Errors in early estimates seem larger for new combat 
aircraft with advanced radars, communications, and weapons, 


Tne same is true for aedvanced engines and guidance systems,” 


ree 
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lA. W, Marshall and W. H, Meckling, "Predictability of 
the Costs, Time and Success of Development," The Kate and 
Direction of Inventive Activity; Economic and Social Factors, 
Naticnal Bureau of Economic Research, (Princeton, N.J.: 
Princeton University Press, 1962), pp. 461-475 


2Norman V. Breckner and Joseph W. Noah, "Costing of 
peycovems,” in Defense Management, ed. by Stephen Enke, 
GengWewood Cliffs, N.J.: Prentiss-Hall, Inc., 1967), 
pp. 26~5/7 








Even though the relationships between tne degree of 
system sophistication, cost, and time, seem apparent ,iehe 
extent of the overrun "factor" is virtually unknown, Prior 
Studies however, have uncovered certain characteristics of 
cost behavior in systems acquisition, Frederic M, Scherer, 
Professor of Economics at the University of Michigan, in 


estimony before the Subcommittee on Economy in Government, 


cr; 


cited trends in weapons systems costs that occurred in the 
past, In a study of 12 major U.S. weapons systems, conducted 
eight years ago, it was found that actual systems costs turned 
out to be roughly three tiines the originally predicted costs, 
That is, on the average, the overrun factor was on the order 
of 220 pexcent, | 
In the F-lill program, for example, the actual costs 
range from 2,2 to 3.0 times the original cost estimates, 


This is practically the same factor observed by Scherer and 


(4 


his associates, While an overrun factor of 2.0 to 3,0 might 

not be representative of all systems acquisitions, the studies 

nevertheless highlignt the problem experienced in cost estimating. 
With the correlation between early estimation errors 

and increasing costs, it may be argued that the cost estimate 


should be developed only after the unknowns are resolved, It 


TT ET DEO Pe eS 





hig Se COncress. Joint Economic Commmstec, Ihe Mitmeamy 
Budget and National Economic Priorities, Hearings, before a 
Sapcommittee on Economy in Government, 9lst Congress, Ist Sess_, 
mune 9, 1969, p. 3/8 
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is noted, however, tUnat early cstimates gee requitred because 
development resources are conStrained, Even if the intention 
is to buy partial or sequential development on a system 
proposal, it must be selected from a wide range of choices, } 
The cest estimate is one aid in preliminary evaluation of 
developmental proposals, As estimates are revised when con- 
fronted with experience, they become credible for analyses 
leading to production decisions, 

Good cost estimates are extremely important, not only 
because weapons systems are becoming more custly, but because 
there are so many systems competing for consideration, In 
ehoosing between various military systems, cost is one element 
Oey choice that cannot be isnored, The cost of one proposal 
must be compared with tne cost of others to intelligently 
weigh costs and benefits, The strategic value of the choice 
or trade off may depend on the cost estimate, The problem 
then becomes one of accuxate prediction while faced with 
uncertainty, Intelligent cost estimating is at least as 
important in military management and decision making as in 
@ay other sector of government activity or in private business 
enterprise, 

Icharles J, Hitch and Roland N, McKean, The Economics 


of Defense in the Nuclear ars (Forge Village, Mass.: The 
Murray Printing Co., 1965), p. 105 











otatement of the Research Question 


The foregoing discussion of cost overruns and the 
degree of estimating errox in development and production 
eosts leads to the specific research question in this study. 
Can the factors contributing to the cost overrun problem be 
isolated and analyzed to develop greater certainty in systems 
acquisition cost prediction? 

An affirmative reply to the question would assume 
that, first, throughout the systems acquisition process, 
certain relationships of activity to cost are present that 
Will generally hold true throughout, Second, that knowledge 
of these relationships, together with intelligent analysis, 
can be applied to cost estimating to reduce the degree of 
predictive error, 

The Scherer testimony before Senator Proxmire's 
subcommittee would suggest that there may very well be fac- 
bors inherent in systems procurement that lead to cost overrun, } 
Further, these factors may occur as a multiplier of the original 
cost estimate, It is the task of this study to attempt to 
identify these factors and determine if they can be applied 


to the estimating process to narrow the degree of error, 
© c 


ee EE ee 


Md Se Congeréss, Joint Economic Commattee, Op, City, 
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scope, Limitations, and Methodology 


Hep 
o) 
og 
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i 


The stuay will concentrate on three broad areas o 
rie preplem, First, a discusston@and CGimetes laa so. 
the Department of Defense contracting practices, These 
generally consisting of fixed price and cost reimbursement 
type contracts, A discussion of intangible relationships, 
Suen as government and contractor optimism, will be included. 
Second, an analysis of national economic trends from 1958 
to the present time, which might contribute to the problem, 
Finally, a discusSion and analysis of the cost prediction 
tools available to the estimator, . These tools include 
teenniques of regression analysis, estimating relationships, 
industrial engineering methods, and analogy. 

In order to put the study into its proper perspective, 
the research question could be further defined in terms of 
the study scope as follows: "Are there certain factors 
inherent witnin the Department of Defense contracting process, 
the economic trends of the nation, and the predictive methods 
available to the estimator, that have a bearing on whether or 
not a program exceeds its targeted cost?" "If so, what are 
they?" Finally; "Jf these factors are known, can they be 
analyzed and the results used to reduce the seemingly inherent 


@eeor mh cost predievion? " 








me 


Limitations 

For purposes of the study, the systems acquisition 
process is divided into four stages, These are research and 
development, test and evaluation, manufacture and procurement, 
and operational. This process division is sufficient to 
encompass the entire Life cycle of a particular system, 
Discussion of factors leading to cost overrun will be Limited 
to the first three, Mention is made of the operational stage 
at this pcint but will henceforth be disregarded, The rationale 
to disregard this stage should become apparent in the following 
paragraph, 

TOMEGNCGRE ace ON Rope Cit 1 CelLactor saicon tiaaielit ee 
cost overrun, it is necessary to define the type of "costs" 
to be the subject of prediction. Costs are divided into 


i 


seeedrring™ and “non-recurring, " Non=reCcurring Costs peliens 
to the research and development and initial investment for 
procurement stages in the acquisition process, Recurring 

costs fit into the operational stage of systems acquisition, 
The Study will consider only the non~recurring costs associated 
Meme caerense procurement, That is, funds used for research, 


development, test, and the actual procurement of the system, 


As previously stated, the operational stage would be disregarded, 


rn ig EO aE EE Mrs 2 hy ST ee ee EY OE 


| ly, P, Lar e, ed,, "Concepts and Procedures of Cost 
Analysis," RH~3589-PR, The Rand Corporation, June 1963 


2Breckner and Noah, Of.JGiey, p. 49 
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jt snould be apparent that costs in the operational stege 
ace of a recurring nature and not the focus of this stuay, 

To provide an overview of the major cost elements 
within a system, Table 2 lists a typical framework describing 
recurring and non-recurring costs, 

A final Limitation is placed on the study, to the 
extent that it will concentrate primarily on the acquisition 
of aircraft and aircraft weapons systems, Much, though not 
all, of recent public attention to the cost overrun problem, 
has been directed to aircraft procurement, The most note- 
worthy exeinple is the Ce5A transport, Congressicnal inquiry 
jnto the C-5A overrun has brought out a great deal of informa- 
tion concerning the problem, That information will be usea 


to present evidence of cost overrun contributory factors, 


Methodology 

Project Design.--Though the study is Limited primarily 
te the procurement of aircraft systems, an attempt will be 
made to generalize the conclusions that emerge. Inductive 
logic is employed to show that cost overrun factors may be 
applicable to the procurement of any system, Likewise, the 
methods of cost prediction and their problems, may be appli-~ 


cable to acquisitions other than aircraft, 


TS ee Oe 





ly, S, Congress, Joint Economic Committee, The Mijitary 
Budget and _ National _ Economic Priorities, Hearines, bdelore “enc 
Subcommittee on Economy in Government, “Olst. Congress, 
Met oess., 1969 








LAD a 


TYPICAL CLASSIFICATION OF WEAPONS 
SYSTEM COSd ELEM wis 
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Preliminary Research and Design Studies 
Design and Development (Of Subsysteins) 
System Test (Of Complete System) 


ie Initial investmen 


e e 


Mun G dhe 


isn Recurring 


Prime Mission Equipment 

support Equipment 

Initial Spares, Spare Parts and Stocks 
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Initial Training 

Military Installations 
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Pay and Allowance 

Equipment and Installations Replacement 

Equipment and Installations Maintenance 

Replacement Training 

Consummables (e.g. fuel, oil, etc.) 

Recurring Travel, Transportation, and Mxscellanecus 





orem 


Norman V. Breckner and Joseph W. Noah, ‘Costing 


Stephen Enke, (Englewood Cliffs, N.J.: Prentiss- 
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Four steps are involved in attempting to isolate cost 


overrun contributing factors and show their effect on cost 


ai 


9 


Lode 


peearction, First, an examination of present and past 


r 
t 


Bepaxctinent of Defense contracting practices, with concentration 
on the aspects which may create an overrun tendency. Second, 

a critical analysis of present cost predicting tools aimed 

at the points least susceptible to control by the estimator, 
Third, an examination of the relationship of economic trends 

to the systems acquisition process, and their effects on cost, 
mmatiy., tHe collection and Listitig of overrun factors” that 
emerge, together with a deductive analysis of effects that 


their control would have on cost prediction, 


BB I TG OO OP aE ene 


directly relating to the problem were brought out by the 
Subcommittee on Eccnomy in Government from January to 

November of 1969, The study relies in part on testimony 

of noted economists and personnel within the Defense Department, 


such as A, E, Fitzgerald, former Deputy for Managemant Systems, 


: . 7 
Department of the Air Force, 


Data is also drawn from nunerous RAND Corporation 


e 


studies in cost analysis, cost prediction, procurement con- 


tracting, and research and development costs, Further, data is 


oO 9 
obtained from a variety of related books, periodicals and reports, 


both from within and outside the Department of Defense, 


G6 < fae Se 


luis, Congress, Joint Economic Committee, Oomeaaee, 
pp. 595-616 





CHAP Ti ial 


A DISCUSSION AND CRITICAL ANALYSIS OF DEPARTMENT 


OF DEFENSE CONTRACTING MmeaHODS 
Defense Contracting Methods 


The weapons acquisition process involves three broad 
types of contracts,. These are the firm-fixed-price (FFP), 
cost-plus-fixed-fee (CPFF), and incentive contracts, The 
Armed Services Procurement Regulations groups the various 
contract types into two main classes based on their compensa- 
tion features, These are: (1) fixed price contracts, and 
(7) cost reimbursement contracts. This classification wil 


be used to present an explanation of the various contracts, 


Fixed Price Contracts 

This contract provides for a price tHet is not subject 
to adjustment by reason of cost experience of the contractor 
during performance, Reimbursement may include a certain sum 
of money per unit delivered or consist of a lump sum payment 
eever contract completion, Such a contract is appropriate 
Wiere definite systems specifications are available and there 


mo a highly reliable basis for pricing. Jt is generally used 


15 
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to precure standard commercial items or those military items 
where accurate pxroduction and cost info@mavion is available, 
Much of the more routine ccnStrucuron Gaweis sae or category. ! 

In practice, the two conditions appropriate for a 
fixed-price contract Go not always remain static. Specifica- 
tions and costs are uSually Subject to change over the long 
Bean and it is necessary to provide for price adjustments 
undexs certain conditions, These modifications to the firm- 
fixed-price contract will be discussed, 


Baxed Price: with Provesions.form bees lal ion. sts icone 


provisions are included in this fixed-price contract, Upon 


fade 


Semercence of specified contingencies, tos cont 


a 
a 


a) voices 


ct 


may be adjusted either upward or downward, A reasonable ceiiing 


elOkmen Talowmom=rrs! via) Lor [6 ne 


6) 


is usually imposed on price increase 


NO 


ct 


S due 


(A 


limiting downward price adjustments, Increasing, cos 
to wage negotiations or rise in material prices during the 
contract term would provide a basis for escalation provisions, 


maxed Pricee wath Redetermination _Proviszons,.--Price 


redetermination provisions are attached to tne contract and 
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luerton J, Peck and Frederic M, Scherer, [he Weanons 
Acquisition Process, (Boston: Division of Research, Graduate 
School of Business Administration, Harvard University, 1962), 
p. 61 


2 ASPR 7-106, 10/7 prescribes various circumstances and 
escalation clauses that may be used, 








Ne 


Pum 


may be negotiated either at stated intervals or retroactively 
woon contract completion. 


Under periodic renezotiation,. a firm fixed price is 
c S 9 


established initially, Future price redetermination provisions 
are included, These provisions state specified intervals at 
which price adjustments may be made. In practic these 

vy 


intervals are generally one year, 

When price negotiation is to be made uven contract 
Genphetion, a price ceiling is established in¥tially. The 
fanal price is negotiated after the completion of the contract. 

Fixed--Price Incentive Contracts (FPIF).--This contract 
consists of a negotiated target cost, a target profit based 
on target cost, a price adjustment formula, and a maximum 


price ceiling. Final cost 1s negotiated upon completion of 


Me contract and the price adjustment formula is used to 
determine the profit, 

Contractor profits are increased as costs axe decreased 
below target, Similarly, as costs overrun the target, profits 
decrease, The incentive to the contractor revolves around 
the price adjustment formula whereby he may increase profits 
by cutting actual costs under the target, The formula is 


constructed to provide a sharing of cost reduction benefits 


Se 62° SU FS) ae eS oe eer ar = oe ee 


eo 8 


linppr. 3.4005 — .7 prescrives the conditions for use 
of price redetermination clauses, 


2Gilbert &. Cuneo, Government Contracts Handbook 
(Washington, D.C.: Machinery ‘and Allied Products Institute 
and Council for Technological Advancement, 1962), p. 146 
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and increasing cost burden between tne contractor and the 
Pepartinont of Defense, Government liability is Jimited by 
the negotiated ceiling price, Table 3 illustrates a Fixed- 


Price Incentive Fee Contract with cost control incentives, 


Cost Reimbursement Contracts 


This majoc class of contract types provides for pay= 


ment of all allowable costs incurred in the performance of 
the contract, Allowable costs in contract performance are 
Specified in the Armed ceervice Procurement Regulations. ! 
Examples of unallowable costs are advertising expenses, 
donations, interest, and other financial costs, 

Cost-Plus-Vixed-Fee Contract (CPFE).--This contrace 
provides for the payment of a eee ee fee in addition to 
all allowable costs, The amount of tne fee is fixed by Law 
and the actual costs incurred in the performance of the con- 
tract do not cnanse it, 

The fee for research and development, or experimental 
work is Limited by law to 15 percent of estimated costs. The 
Maximum fee for other work under this type contract is 10 per- 
cent. By regulation however, the Department of Defense has 
limited these fees to a maximum of 10 percent for R&D and 


7 percent for other work, 


laspR 15, part 2 


2Frederick T, Moore, “Ineentive Contracts,” Detimmae 
Management, ed, by Stephen Enke (Englewood Cliffs, N.J.: 
Premeies-Hall, Inc. , 196/), p. 215 - 
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Liebe 
FIAED=PRICE-INCENTIVE--FEE CONTRACT 
(Cost Control Incentive) 


PIS 2 ee eo ~ EB NEES ES OF OD RE RS a a ORE AT Nk tg SR TNS ORR a OT OR ITN CT Pi A Pe TO tae Te De EE we NT CL SII a I A TE OL ie Sy SD CB OAL OS 
Semi SPI K > 5 pee SLT ED A AE ORES OU PEI FF aS ER iP ORS ET Ea Pn Cope OE 6 A ag a PCS A Te EO RTD EE MER FR Oe 





Negotiated 


Target Cost oe 50002 G00 
maepet Profit (7%) 140,000 
Target Price $2,140,000 
Price Adjustment Formula: DoD: 15% 
Con tisseire =: Wy fs 
Price Ceiling (125% of Target Cost) S2 5005 Ces 
Meorit Ceiling (12% of Target Cost) 240,000 
__Actual 
metual Cost Sl'y600;000 
Cost Underrun 700-000 
Contractor Profit Target 140,000 
25% of Cost Underrun 22000 
Total Profit Sl FOR OO0 


Government Cost: 


Pepual ’Goncractor Cost $1,800,000 
Comeractor “Profit 190,000 
Total Cost to Government: Sl, 2908600 


OPrreass =a 
ee ee eee 


Note: A cost overrun would involve the same calculations 
but would result in a decrease in contractor profit 
and increase in government cost, 
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cost-plus-fixed~fee (CPFF). The CPFF was much more widely 
used to procure military hardware, Incentive contracts were 
introduced primarily as a substitute for the CPFF contract. | 

During the 1950's, the use of the CPFF contract 
increased Steadily end accounted for approximately 40 percent 
of new contract dollars, By 1966, however, that figure had 
decreased to about 5 percent. The incentive contract had 
accounted for virtually all of the difference, When the 
decline in CPFF contracting began, the slack was taken up by 
CPIF and FPIF contracts. Since 1964, however, FPIF usage 
Pas increased only slightly, while CPIF usage has fallen 
substantially, 

A Department of Defense drive to increase the use 
of fixed price contracts has produced a rapid turnabout, 
particularly in Air Force procurement, By 1966, at least 
half of Air Force procurement funds were obligated by firm- 
fexed-price contracts, yet these contracts accounted for 
only 15 percent of research and development purchases and 
only 9 percent of complete systems percha 


Complete systems purchases are the major concern of 


mars giscussion. fo isolate contributing factors to cost 


SS eg eS 





lipbid., p. 214 


2Gerti Le Brunner and Georee KR: Hall Aree Gece 
Procurement Practices (1964-1966), RM-5439-PR (Santa 
Monica, Calif.: The Rand Corporation, April 1968), p. 15 


*Ibid., p. 15 
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overrun in systemS acquiSition, primary emphasis is placed 
on contracting methods chiefly employed in the past and 
present, The current trend in systems acquisition is to 
wtrlize the ancentive contzvact fommemmsuch 2ouleP Or song 
cpir,? lable 4 summarizes the Air Force dollar outlay by 
contract type for research and development, and complete 
system purchases for fiscal years 21964 through 1°66, In 
mBesearch and development, the CPIF tends to be vwthe centract 
type most often employed, Similarly, complete systems 


2 


acquisitions seem to be made mostly with the FPIF contract. 


Critical Assessment of Government Contracting 
The Weaknesses of Cost-Plus~Fixed=Fee 

the distinguishing features of cost~plus-fixed-~fee 
(CPFF) contracts are, that the government agrees to pay a 
fixed target profit, absorb costs in excess cf target costs, 
and places relatively little restriction on total costs, 
These characteristics appear to offer a reverse incentive for 
the contractor to control costs, Since the fee is a fixed 
ement, incurrims additional costs affects profit only as a 


decreasing percentage of total cost, Should the contractor 


mee ale = 
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IPPIF includes fixed price with escalation provisions, 
and fixed price redetermination contracts, 


2Brunner and Hall note that: "The contractor who 
receives the R&D contract for a weapons system will usually 
receive the follow-on contract for systems hardware. .., 
even thoush separate contracts may be let for each stage," 
BoyeGit., p. 2/ 5 
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TABLE 4 


ALR FORGE PROCUREMENT BY PRODUCT GG. Ua De te 
OF CONTRACT, FISCAL YEARS 1964 THROUGH 1966 


(In $ Millions) 
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come under pressure from the government to meet a work dead- 
line, the tendency has been to relax cost controls to meet 
the schedule, 

Normally, should the contractor overrun the estimated 
cost, prorit remains constant but decreases as a percentage 


of the total Bae 


It has been argued that this decreasing 
rate of profit in an overrun environment, still provides an 
micentive for the contractor to control costs, Nash curtiy 
dismisses this argument as follows: 

This (decreasing rate of profit) is surely a minimum 
incentive and most commentators have agreed that this 
type of contract provides a minimum incentive in the 
cost area, 

Moore notes that it is fairly common for contractors 

to benefit from increasing costs with increasing fees, The 
parties to the contract tend to uSe it aS a means to order 


additional work for which the contractor is entitled to 


additional SrRoseine = 


Lthe profit can increaSe if the original work 
Scope is changed and there are subsequent negotiations 
covering the change in program concept. 


tpalph C, Nash, Jr., "Cost Plus Fixed Fee Contracting," 
in Research and Development Contracting, (Washington, D.C.: 
Bederal Publications, Inc., 1963), p. 109 


3Frederick T. Moore, Military Procurement_and 
Contracting: An Economic Analysis, RM~2948-PR (Santa 
Monica, Calif.: The Rand Corporation, June 1962), 


Pp. 35 





In a 1962 report, govervmmenteoffii cals eriticiced 
the disadvantages of tne CPFF contract as follows: 


It (CPFF contract) provides Little or no incentive 
for private managers to reduce costs or otherwise 
increase efficiency, Indeed, the cost-plus-fixed-fee 
contract, in combination with strong pressures from 
governmental managers to accomplish work on a rapid 
time schedule, probably provides incentives for ising 
ratnes than for re@quemis cosets. If a ceo@perateaw ic 
judged in terms of whether it accomplishes a result 
by a given deadline rather than by whether it accom- 
plishes that result at a minimuin cost, it will naturally 
pay less attention to costs and more attention to speed 
of accomplisnment., On the other hand, wnere thexe is 
no given deadline, the cost-~plus-fixed-fee contract 
may serve to prolong the work and induce the contPactor 
to delay competition. 


In recognition of these disadvantages, the government 
has antroduced cost controls over the years, to monitor con- 
tract performance and gain assurance that the contractor is 
Bropecly managing the work. Examples of such controls include 
requiring the contractor to obtain government approval to 


incur overtime costs. Government approval is likewise 


wegquired to subcontract work in excess of a specified dollar 
° } : e e 2 
Peunt, or tao make a product enganeering change. Lhe most 


recent of these controls was Department of Defense Instruction 
Mo. /000.2, entitied "Performance Measurement for Selected 
Acquisitions," This instruction was introduced in December 


196/, It requires the contractor to adapt his internal 
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Ipureau of the Budget, Report to the President on 
Government Contracting for Research and Development, 
Wo0eApetl 1962), p. 32 


ZASPR 12=102.3(a) out iaiies the requirements for 
overtime and shift premium payments, ASPR /-203.8 deals 
‘Ell SWDeOn Geac tc. 





management control systems to provide data which (1} indicate 
work progress, (2) properly relate cost, schedule, and tech- 
nical performance, (3) are valid, timely, and auditable, and 
(4) supply DOD managers with a practicable level of summariza- 
tion. A copy of this instruction will be found in Appendix A, 
euch controls are not without their omdisadvme ses . 
both for the contractor and the government, They require 
accountants, auditors, and contract administration personnel, 
wnich add another element of cost, With these additional 
personnel requirements, the CPFir contract tends to be more 
expensive to administer," The controls are a reflection on 
the nature of the CPFrF contract, in that there is a minimum 
Macentive Lor the contietor to control costs. Controls of 
this nature would not be required on a firm-fixed-price 
contract and are specifically excluded by DOD Instruction 7/000, 2. 
Nash holds the belief that the practice of instituting 
contract cost controls tends to insert government into con- 
tractors management to a great decree, Ine@adeGstaon, the 
contractor is subject to close serutiny of all his contract 
G@ets and may incur expenses in justifying certain costs. If 
the contractor realizes that a cost overrun will occur, a 
series of discussions, explanations, and justifications may 
result. Nash advances an opinion aimed at this tendency of 


government: 


tNash, @We_Cit., p. 110 
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The interference by government into contractor 
Management is of questionable benefit .. . . This 
interference is ~beneigcial tognei GmiSma wey deen 
eddition, is one of the causes of the failure i 
Comtractors to controtmecosts on Clif cenertcrc. 

Apparently, this injection of control Eemcereuia 2 

contractor performance has resulted from past abuses of the 
mer rwcontract. 


Cert! cecGmtcacts are subject to further critreren aa 


the premise that contract work may be commenced without a 


tety 


firm estimate of cost, As a result, the Department o 


{ 


Defense may be eon Ceased in making valid program decisions, 
Since firm cost estimates are lacking. This further tends 
to detract from the reliability of Defense budget estimates, 
One additional disadvantage, to which the CPFF is 
peene, 1s called “®Suying in.” in this situationg, the cea- 
tractor may bid an unrealistically low price in order to win 
the contract, A cost overrun would result in the contractor 
receiving the fixed fee, but a lower percentage of total 
cost, Jt may be argued that the contractor's return on 
investment is reduced thereby minimizing the buy-in tendency. 
Reewick, however, believes that if the contractor is short of 


other work and cannot maintain production capacity, reduced 


return on investment would not be a sufficient deterrent, 
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lipbid,, p. lll 





2Rernard H, Rudwick, Systems Analysis for Effective 
Planning, (New York: John H. Wiley & Sons, Inc., 1969 
p. 422 
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Gritical Aspects of Incentive Contracting 

The primary purpose of establishing the incentive 
contracts was to improve contractoxc efficiency by lowering 
costs and raising the level of performance, The incentives 
offered ace usually monetary in nature, They may be based 
on edherence to cost or price estimates, performance 
standards, or both, 

Incentive contracting, in general, falls at a relative 
point between FFP and CPFF contracts, FFP and CrFF contracts 


are two polar cases, The incentive contracts are Fixed Price 


4) 


wan Incentive Fee (FPIF) and Cost Plus Incentive Fee (CPIF). 
Both involve a target price or cost, target pro 
sharing foxrmula. 

There are certain differences between FPIF and CPIF 
Semeracts, the FPIF contract usually sets a price cezling 
expressed aS a percentage of the target cost, The CPIF 
Gees not, CPIF contracts generally possess no requirement 
that the task be completed within the Limits of the funds 


} 


fete contract, However, a maximum and minimum fee are 


re 


specified, 


The FPIF contract is the type most commonly employed 
in complete systems acquisition, Table 4 tends to support) 


this assertion, For this reason, the discussion will be 


ee Pe Ree 





Re mathe aa ga RSE a 


IMoore, Op, Cit., p. 221 


Pate 2 a. tlley hn EE Ree a. ee 





29 


directed to the FPIF contract, However, Fitzgerald believes 
tnat the disadvantages of FPIF are also common to CPIF 
contracts. ! 

Probably the most serious obstacle to effective 
incentive contracting is the difficulty in setting the initial 
target costs or prices, These contracts have been criticize 
for poor estimation of targets, particularly for setting 
mae Carget price artificially high. If the target price is 
fer higher than the expected price, the contretctor is in a 
Deecee position to ‘remain within the target, and perhaps 
maCcuI an underrun, The extra profits, based on the sharing 
formula, would appear to result from contractor efficiency, 
but would actually be due to an artificial estimate, 

Past trends seem to indicate that costs of military 
items are not estimated with the same accuracy as their 

; 2 
counterpart commercial items, In this respect, the position 
of the Dapvartment of Dafense is adverse to that of the 
contractor, The government's position is to negotiate a 
target price as close to expected levels as possible, On the 
other hand, actual costs may increase sharply during the work, 
and the contractor's strategy is to avoid serious cost over- 
Bees, ine overrun could deplete profits in accordance with 

Luls., Congress, Joint Economic Committee, Militarv 
puaret and National Economic Priorities, Hed@Pings, before a 
Subconmittee on Economy in Government, 91st Congress, 


Ist Sess., 1909, pp. /85~-/94 


eMoore, Coens pe 220 
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the terms of the shatains formula, Ine tendency ais fom unc 
Contractor to attempt tomnegotiate a Career or fee 11ac 
exceeds his expected costs, The gravity of this situation 
is stated by Moore as follows: 

To hand a cuntractor a large windfall profit that 
results from an exaggerated target cost is the anti- 
thesis of an incentive, and weakens the effectiveness 
of the sharing formula, 

Negotiations fox the Mark II Avionics system for 

the Fell] with Autonetics, appear to exhibit both the 
tendency to exaggera ate Eee 2neeial Estimate ot cost, ead 
also poor estimating of actual program costs, The original 
contract included a target price of $145,3 million, The 
price was based on a target cost of $132.2 million proposed 
by Autonetics, a profit of 10 percent, end a ceiling price 
of 120 percent of target cost. Autonetics' original 
estimate was for $183 million, but agreed to reduce this by 
$38 million in order to obtain the contract,” 

It soon became apparent that Autonetics would be unable 
to meet even the contract ceiling price. In the period from 
September 1966, through March 1967/7, Autonetics made five new 
price estimates, Each was higher than the previous, By 


early 1968, it became apparent that the actual costs might 


reach $320 million, Tnough all the reasons for the cost 


lipid, , p. 220 


Zu, 5, Congress, Joint Economic Committee, Military 
Budget and_ National Economic preoritires: Hearings, Op. Cit., 
p. oo 
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overrun are unknown, a substantial portion has been attributed 
to design changes made by the contractor, At least $60 
million was attributed to estimating error, The exact 


] 


particulars of the estimating error are not specified, 

On one hand, Autonetics was accused of submitting 
Poeartificially hish bid of $183 million. nen desien and 
performance problems arose, costs rose rapidly, and some 
estimating error was uncovered, Wnen costs approached 
$320 million, Autonetics was accused of making a "buy-in" 
bid, This latter charge will be discus@@éd in the following 
section, 

Buy-In Bidding on Incentive Contracts,--the cost- 
plus-fixed-fee contract was previously criticized due to 
its susceptibility to a buy-in by contractors, The reason 
Biven was that there was Littie incentive to control costs 
and the contractor could make an unrealistically low bid, 
His fee would be affected only as a lower percentage of 
the expected costs. the incentive contracts were introduced 
wath the intention, not only of controlling cost and improving 
performance, but of eliminating the buy-in bid, Introduc- 
tion of a ceiling price, and decreasing profit pattern in 
the overrun situation, were intended to eliminate this 


tendency. 
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lu.s., Congress, Joint Economic Committee, Military 
Budget and National Economie Priorities, Hearings, Op. 
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Experience with the C-5A and Mark II Avionics System 
seem to indicate tnat the incentive provisions of contracting 
are not eliminating the buy-in. Concerning the Mark IT] 
contract, Major General Murphy pointed out the apparent 
intentions of Autonetics in their bid submissions: 


It appears that the contractor knew very well 
wnat he was getting into but was so intent on winning 
the contract, that he was willing to buy in at a low 
price, 


The rationale advanced by General Murphy for the 
Autonectics bid are stated as follows: 


The contractor believed that he would not be held 
to the written agreements made at the time of Source 
selection. . . . Autonetics adopted the stratesy of 
reproposing without regard to the original contract, 
contending that the contract was not valid, The 
company failed to recognize, or did not believe, that 
the procurement system was shifting from oral promises 
to written agreements, ... Jf it fails to enforce 
tne contract, the Air Force and the Pepagtinent of 
Defense can count on many more years of misleading 
promises from contractors_and failures to meet 
contractual requirements, « 


Me, A. E, Fitzgeraid, in testimony besore erie 
Prexmire Committee, contended that there was similar evi- 


dence of a buy-in by the Lockheed Aircraft Corporation in 
6: 


fae C-5SA contract. Both contracts were Fizxed-Price-Incentive- 


Fee, 


a oe 


1. ; : 

Major Generel Jolin K, Mumpum, Dimector, Legislative 
72S 1ON ,wumemasctment of the Air FOm@@ey in@a letter to Senator 
William Proxmire (Washington, D.C.: June 20, 1969) 


2 ibid. 
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“U.S. Congr@ees, Joint Ecememic Committee, Op, Cit., 
pp. 595-615 
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In the light of this testimony, it appears that the 
buy-in tendency 1S present an) the incemitive comtegge lucas 
well as cost reimbursement types. 

Uncertainties Affecting the 
Target Cost Estimate 

To deal effectively with a target cost estimate, 
the degree of uncertainty must be considered, Probably the 
foremost uncertainty encountered in weapons system acquisition, 
is technological uncertainty, The degizvee of technological 
uncertainty tends to influence the accuracy of the cost 
estimate, 

If a system to be procured incorporates components 
and design which have been utilized in previous systems, the 
degree of uncertainty tends to be reduced, The task of 
arciving at a reasonable cost estimate is less demanding. 
Previous experience could provide adequate data on which new 
systems costs could be based, Such is not always the case, 
Modern weapons systems are characterized by increasingly 
complex components and advanced performance requirements, 
Schultze states: 

The increase in complexity is driving the costs of 

systems to a point 10 to 20 times wnat they cost at 
the time of the Korean conflict. 
The point at issue is that considerable technological 


advancement is inherent with this increasing complexity. 








lcharles 1, Schultze, in testimony before the 
Subcommittee on Economy in Government, Op, Cit., p. 65 
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There tends to be an insufficient pricr data base on which 
to make cost estimates for future systems, 

Anothec uncertainty affecting the original target 
cost is uncertainty in ultimete performance requirements, 
At the time development 18 commenced, the final system form 
may not be specifically defined, Changes may be introduced 
by dynamic tactical requirements, or brought about by 
achieving a new Level in the state of the art, Once the 
system has been initially costed, any further changes will 
ferme to bring on ihereesine prices, 

In this situation, changes to the target cost initiated 
by the government, axe usually subject to negotiation. 
Government responsible changes in the Mark IL system were 


reported to be $20.2 million, 


Optimism in Program Decisions 
Getting a new weapons program going is not easy, 
Ws diseussed, there are substantial risks and uncertainties, 
Realistic cost estimates tend to have a sobering effect on 
the Department of Defense hierarchy. Permiaus, a Lealistac 
estimate of tne cost of a proposal, may place it in an 
unattractive position before the Congress, For this reason, 


considerable optimism tends to pervade initial prograin 


decision making, both on the part of the contractor and 
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luis, Cagerese, Joint Economic Committee, Only eee, 
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the Department of Defense. Scherer comments on this tendency 
aoe ToL lows : 

Industrialists and military officers are inclined 

to view a programs future prospects through rose tinted 
glasses, ‘There is a commnon belief that one should not 
rock the boat vigosously throush criticism at the start 
of a program, the assumption is that troubles can be 
pin pointed and corrected later on when the program has 
its momentum, this attitude contributes significantly 
te the subdsequent appearance of cost overruns , revel 3116 
can lead to seriously defective decisions, 

Initial optimism has been evident in several past 
programs, notably the Skybelt and Nike-Hercules air defense 
missle system, 

The contractor for the Skybolt program was the 
Douglas Aircraft Company. In 1958, Douglas competed for 
the Minuteman ICBM program, but Lost the competition to 
Boeing. After this defeat, Douglas found its backlog 
Situation desperate. Skybolt seemed to be the best oppor- 


tunity, and it competed aggressively in the design competition, 


It abandoned its traditionally conservative engineerin 


CQ 


philosophy. It accepted extreme technical risks in order 

to promise maximum technical performance, It underestimated 
the difficulties of the Skybolt development tasks, submitting 
optimistic cost and delivery date estimations in the expecta- 


tion that it would be bailed out a year or so later when the 


| ; 2 
final contract provisions were estimated, 


Ischerer, testimony bafore the Subcommittee on Economy 
in Government, Op, Cit., p. 3/79 


“ibid. , p. 380 





By 1962, the cost of the program, originally 
estimated at $890 million, had risen to $3 billion, amd 
was still aii pee The program was eventually cancelled, 
The second case involved the Nike-Hercules air 
defense missle system, the prime contractor was Western 
Electric. Formal development began in 1953. At the time, 
the research and development team presented estimates of 
the costs to convert the existing Nike~Ajax units to use 
the Nike-Hercules, They said it could be done at $210,000 
per battery cnoese B field modification. However, two 
years Later, during contract negotiations, they presented 
anew estimate, they then seal GRE: it would not be possible 
to make modifications in the field’ and instead should pxroaduce 
the equipment at the factory for $1./ million per unit, 
Scherer comments on this case as follows: 
Western Electric officials admitted that theine 
production enginecring staff members knew early in 
the program that a field modification would prove to 
be impractical, but that they presented the highly 


optimistic cost estimates because rhey were more 
sellable to the Army and Congress, 
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A DISCUSSION OF COST ESTIMATING 


METHODS AND PROBLEMS 


Criticisms Leveled at the incentive contract series 
iaetae previous discussion cited “realistic target costs" 
as being a key contractor performance determinant. Had the 
target cost been set unrealistically high, any underruns 
resulting during aera performance might appear to be 
contractor efficiency, wnen in fact poor estimating tech- 
meaue cotild really be the reason, Similarly, in a cost 
overrun situation, a probable explanatory factor is bad 
adtinon. * Robert N. Anthony, former Comptroller for the 
Department of Defense, stated the relationship of estimating 
to the quality of incentive contracting before the Subcommittee 
on Economy in Government: 


It Vineentive contract) is a good, contract, 
provided you can estimate the costs, 
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live es not preclude the possibility of an intentional 
underestimate such as the "buy-in" bid, Peck and Scherer state: 
"Cost quotations were deliberately underestimated by contractors 
in order to sell the program to the services," in fhe Weapons 


fei S3.ti.on Process; (Boston: Div aS em) Or Nesearci, h, Graduate 
School of Business Administration, Harvard University, 1962), p. 19 
2 


U.S, Congress, Joint Economic Committee, The Military 
Budget and National _ Economic | Prvomreres .. Meg arings, bofome a 
Subcommittes on Economy in Government, “Cis tC <GONS2 esos 
pess., 1969, p. 32 
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This comment provides an introduction for a discussion 
of cost estimating techniques, their problems, and their 


relation to cost overrun, 


Definition and Perspective 

A cost estimate, as used in this discussi6n, is a 
judgement or opinion, regarding the non-recurring cost of 
Meduahine a weapon system; to include research, develoriene. 
teot,wevaluation, production and procurement, but generally 
not the recurring, costs of operation and maintenance, 

In the acquisition of a system, such as the Mark ILI, 
Secumates of cost are made at Various stages in the process, ! 
Breckner and Noan noted that estimation accuracy tends to 
increase as the system progresses in development, They 
attribute this tendency to experience gained in converting 

ee . 2 - ae we . 
unknowns to knowns, [OWES HOt CO COntuse experience refine- 
ments with early estimates, cost estimating, as used herein, 


shall refer primarily to the "initial systems cost estimate," 


Cost Es Dinas —leeesaucs 
The techniques used for estimating systems costs range 


from intuition at one extreme, to a detailed application of 
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1 auconetics made total cost revisions in June 1966, 
June 1967/7, and January 1968, These are itemized in detail in 
testimony before the Subcommittee on Economy in Government, 
U.S. Congress, Joint Economic Committee, Op, Cit., p. 804 


2 : . 
Nowmten V. Brecker <ifd Joseph . Noah, "Costing of 
Systems," in Defense Management, ed. by Stephen Enke, 
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labsr and material cost Standards at the other, the Air 
Force cost estimating manual lists five basic cost Estimating 
methods, These are Industrial Engineering Standards; rates, 
factors and catalogue prices; estimating relationships; 
Specific analogies; and expert opinions: Other sources 
describe cost estimating methods as synthesis anda analysis; 
round table estimating; estimating by comparison; detailed 
estimating; analytical appraisal; comparative analysis; 
Statistical; and standards, 


a 


This discussion shall not be all comprehensive but 


rie & 


wet) Lamit the "@xantitiat@en to three Weelmt@tes; tite 


C 


Industrial Engineering approach, anatoey and tne statis~ 

tical approacn, 

Cost Estimating by Industvial Eneineering Procedures 
Estimating by Industrial Eno ineeumiate procedures is 

broadly defined as an examination of separate segments of 

work at a low level of detail and a synthesis of the many 

detailed estimates into a total. At the lowest level of 


detail, the estimator begins with a set of drawings and 


Specifies each engineering or production operation that will 
be required, the work stations where each operation will be 


performed, and the labor and material that will be required. 
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larse Manual 173-1 


23, P, Large, An Introduction to Equipment Cost 
Estimating, RM-54/0-SA (The Rand Corporation, January 


the detail required at the Lowest level of estimation 
is illustrated in Table 5, Formation of a center bracket 
of steel plate is the example used, The name and number of 
the operations and the machine that will be used are given, 
aiong with estimates of the set-up time and epexatine labor 
cost. Standard set-up and operating costs ere used in 
making the estimates whenever these exist. If standards 
have not been established, a detailed study is made to 


lal 


determine the most efficient method of performing each 

operation, ! 
The low level estimates are aggregated at each 

Succeeding level, until a cost estimate for the »entire 

system is attained, For example, the bracket in Table 5 

could be a basic part of an aixplane wing. The estimates 

for all the parts constituting that wing are assembled 

@nd totaled to estimate the cost of the wind. Likewise, 

the assregated costs of the fuselage, landing gear, engines, 


ming subsystems are brought together and totaled, 


tale 


ana  7eMma 


The 


ry 
'@) 


esult is the cost estimate for the aircraft, One of 
the largest aerospace firms figures that approximately 
mee) estimates of this type are required to estimate the 
cost of an airframe using the Industrial Engineering 


approach, 
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Cost _ Estimatine by Analogy 

Estimating by analogy derives the cost estimate 
by looking at experiences acquired in the production of 
& past system, and applying these experiences to the 
production of a future system, given certain likenesses 
and differences, For example, if System A required 
100,000 direct labor hours, given the likenesses and 
differences in design and performance of proposed System 3B, 
the requirement for B mignt be estimated to be 125,000 
Mewrs, Starting in the 1950's, aircraft companies bidding 
on ballistic missle programs drew analogies between air- 
craft and missles to develop cost estimates for the missles, 
J. P,. Large cites an example of drawing an analogy fron 
aircraft production and extending this experience to a 
proposed missle system: 

Douglas Aircraft Company made a g00d cost estimate 
on the Thor intermediate range ballistic missle by 
comparing. Thor with the Douglas DC-4 transport 
airplane, 

Douglas encountered a different situation at a later 
time when attempting to apply experiences gained in Thor 
construction to cost estimates of the Saturn S-IV stage, 
After adjusting for differences in size, the number of 
engines, higher performance and insulation problems, the cost 


2 


estimate derived by analogy resulted in a cost overrun, 








ee See 


libid., p. 5 


2tbid., p. 5 





Statistical feckniques in ost gis tiem on 

In the statistical approach to cost estimating, 
xplanatory variables such as weight, speed, power, 
frequency, and thrust, are used to develop estimating 
Felationships, The estimating relationships im turn, are 
relied upon to predict costs of the system, Most estimating 
relationships are simple statements indicating that the cost 
Gr Some system is directly proportional to the wedght, area, 
wolume, or some other physieal characteristYre of that system. 

The emphasis is not on statistical theory or the 
Gemputatwonal aspects of statiewics. Rather, some basic 
considerations are presented, which are involved in developing 
estimating relationships to be applied to equipment cost 
estimating, 
Developing the Estimating Relationship and Regression 


Analysis.--An estimating relationship assumes that there 


is some cirect relationship between cost and some other 


xplaunatory variable, The problem is to discover the 


appropriate relationship. This is done by first, deciding 


what variables are logically or theoretically related to 
@@et, and then, by looking for patterns in the data that 
suggest a relationship between cost and these variables. 


Large indicates that weight is a widely used explanatory 


variable because of the generally held belief that as an 





aircraft, ship or missle increases in weg. ic besencs 
more costly, + 
To illustrate this concept, assume that data were 
available on 10 previously produced aircraft, Figure ] 
lists cost and weight data on 10 hypothetical aiteraft. 
if this data were displayed graphically, it would immediately 
become evident that the data conforit to a straight line, The 
apparent relationship between cost and weight in this example 


1s a linear function, The equation of this line would be: 
Y = aon 

The independent variable "y" (cost) is a function of some 

Constant "a" ($2,500,000), plus the product of the aircraft 


WoL 


0) 
0? 


ht (x), and the slope of the line (b).7 The resulting 
line is a regression line of "y" on "x," An estimation of 
Mie velio of a variable "“y" (cost) can be obtained from 2 
corresponding value of "x" (weight), from the regression 
line which fits the data, 

The estimating relationship is the regression equation 
obtained from the data, To apply this estimating, relationship 


? 


bomtie construction of a new airevaft, suppose the weignt of 








lipid., p. 33 

évathematical derivation of a linear function is 
presented by John E, Freund, College Mathematics with Business 
Applications , (Englewood Cliffs, N.J.: Prentiss-Hall, Inc., 
1969) pp. Yl- 295 


SMurcay R. Spiegel, theorvyeaend Pr@piems of Statvetter. 
(New York: McGraw-Hill Book Co., 1961), p. 221 
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the proposed aircraft is to be 300,000 pounds, Utilizing the 
sstimating equation: 

Cost =) 255007000 + 20 (300,008) 

- 8,500,000, 

mesuming, that the cost to weight relationship is valid, the 
cost estimator might state that the cost of a 300,000 pound 
aircraft would be approximately $8.5 million, based on 
prior experience, 

In actual practice, the values of aircraft cost to 
welgnt would not usually correspond exactly to a straight 
Jine when graphed, Exact correspondence would be extremely 
rare, ! To deriveme useful relationship in that sease, the 
estimator could attempt to approximate a linear regression 
line by applying the method of least squares to fit a 
straight line to the ae The problem is to derive esti- 
mates of the parameters of “a (constant) and "b" (slope of 
the regression line), such that the regression equation will 
approximate the sample data as closely as possible, The values 
of "a" and "b" are determined by the requirement that the sum 
of the square of the deviations of the sample observations 


from the regression line will be at a minimum, The two 


normal equations for linear regression are: 


liaree, @5, Cit., pw. 3e 


2Ccomputational techniques of the Least Squares 
method is treated by John E, Freund, Elementary Business 
Statistics, (Englewood Cliffs, N.J.: Prentiss-Hall, Inc. 


Ae ae 


1964) pp. 304-307 
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if 


In this example: 


VY S=.C0S tO 40ne aarcraie 
X = weight of the aircraft 
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n= number of observations in the sample 
> = sum of 
SUBSTLEULINg the Wapproprerzate values of xj) ,. ance 
into the normal regreSsion equations, and solving simul- 
taneously, yields the linear equation of the form y = a + bx 


for the regression line of bast fit to the aircraft data, 


a 


Tne usefulness of cost prediction of a regressic 
line depends on the extent of the dispersion of observed 
values about the line, The greater the dispersion of 
observed values of y about the regression Line, the less 

] 


accurate estimates based on the Line are Likely to be, 


Lee berate chnudMuesmetmenersession analysis.-= fn 





examination of graphically portrayed data of cost and weight 
might indicate that a linear relationship iS appropriate, 
Pewever, it cannot be concluded definitely that some type of 
non~linear relationship might not be preferable. One form 
frequently used is logarithmic regression, The basic 
equation is: 


b 
Y = ax 
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The variables of the equation are transformed 
logarithmicly, The resulting edauation is linear in the 
logarithms of the variables: 

Log y = log a + b (log ou 

The first step is to take the original date for x 
end y contained in Figure 1, and convert these data to 
logarithms, The next step is a simple Linear regression 
analysis of the data in logarithmic form, 

A&A third form of regression analysis considers the 
effect on cost of more than one variable, This technique 
is known as Multiple Regression Analysis. An example of 


this technique would be analysis of the effect on cost of 


O 


° 3 e Z is e 
both weight and speed, or weight and thrust, The equation 


of multiple regression is of the form: 


Z = see ey 


Problems with Cost Estimating Methods 


Cost estimating by Industrial Engineering procedures 
requires numerous detailed estimates starting at a low level 
of detail. It was previously cited that approximately 


4500. estimates were required to estimate the cost of a typical 
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lypid., pp. 50-53 


The computational aspects of multiple regression 
analysis are relatively involved, For treatment of computa- 


Bronswas well as a matneMatical derivation of the equation, tie 
Meader is referred to J. P. Large, An Introduction to Eaimggmone 


oer oe eer rs 


Cost Estimating, RM~5470-SA (The Rand Corporation, January 1968), 


-_aewe 


pp. 60-65 





airframe, For that reason, Industrial Engineering cstimates 
are time consuming and costly. They require more personnel 
and data than are likely to be available to eovernment 
estimators, 

Industrial Engineering estimates have been found to 
be less accurate than statistical estimates in many cases, 
Large states that the reason for this is: 


That the whole generally,turns out to be greater 
than the sum of the parts. 


Because of this reason, and for cost, time and personnel 

considerations, aircraft manufacturers and government 

estimators tend to avoid using the industrial engineering 

.. 3 

approach, 
Industrial Engineering estimators must also work 

with the uncertainties that are common in aircraft production, 

tecnnolcgical uncertainty being the foremost. As systems 

become increasingly complex, the difficulty lies in specif- 

ically defining the character of the proposed system, To 

make a reliable estimate of manufacturing costs, the estimator 

4 « ty ° 
must know all the elements that go into them, Experience 


has indicated that changes or modifications are made to system 


specifications at different stages of development and 





‘ibid., p. 2 STi p. 5 3ibid., p. 6 
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‘Thomas F, McNeill and Donald S. Clark, Cost 
Estimating and Contract Price, (New York: American 


Elsevier Publishing Company Inc., 1966), p. 154 
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production, For example, Autonetics inade significant changes 
to its designs of the Mark II Avionics system after aaa ciel 
cost estimates had been made, These changes were made while 
development was going on in parallel in order to meet the 
original performance specifications, 

It is clear that changes of this nature could have a 
considerable impact on initial cost estimates. The Industr 
Paetneering estimator, working from sketches, blueprints, or 
word descriptions of some item that has not been completely 
designed is at a eee sadvantage. He can assign costs only to 
that work he knows about in advance, Even assuming that no 
aesign changes were made Eaeoten the first produ@eicn sung. 

a particular aircraft, experience shows a tendency for produce 
tion runs of like models to be of limited length and charac- 
terized by numerous design changes, Production rates have 
tended to vary frequently and unexpectedly, with the subsequent 
introduction of new or changed components, Large notes that: 

The proportion of new components introduced during 

a production cycle is proba ably higher in the airframo 
industry than in any other, 


These changes cannot be known to the estimator in advance, thus 


the tendency to introduce error into the initial cost estimates, 





luis, Congress, Joint Economic Committee, The Military 
Budget and National Economic Priorities, Hearines, “before the 


Subcommittee on Economy in Government, 9lst Congress, Ist Sess,, 
pp. 800-80) 
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Analogy 

Toe major drawback to cost estimating by analogy is 
Stated by Large: 

Estimating by Analogy is essentially an intuitive 
process, and aS a consequence requires considerable 
experience and judgement to be done successfully, 
statistical, procedures are preferable in most 
Situations, 

In spite of this drawback, Large explains that it may 
be necessary to resort to the method of Analogy in some cir- 
cunstances because the available data do not provide a 
systematic basis for estimating cost behavior, 7 lhe Douglas 
Aircraft Company based missle cost estimates on aircraft 
production experience, as previously cited, A great change 


in technological requirements in that case left relatively 


little experience data on wnich to base a cost estimate, 


weeeretical Techniques 

An estimating relationship can only be derived from 
information on what has occurred in the past, The past is 
not always a reliable guide as to what will occur in the 
fwmre, Thus, statistical estimating is subgect to uncertainties 
which also tended to be drawbacks to Industrial Engineering or 
Analogy cstimating techniques, 

The uncertainties to which statistical estimating is 


Eoene, Stem from two sougecs: 


OPO ee ee ee ee ne ee ee; 
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(i) ‘The uncertainty inherent in any application of 


Seamer St ics. 


g) 


(2) The uncertainty that an estimating relationship 


is applicable to a particular system, 

Concerning the fisst source of statistieal vnceresiacy, 
little need be said, other than a word of caution stated by 
Freuna: 

So far as forecasting and estimating from statistical 

data is concerned, it must -be ema ed that any pro- 
JeCC#en .of past experience, to the uncertain future is 


speculative and hazardous. 


On the second source of uncertainty, whether or not 


q 


the estimating relationship is applicable to a particuler 


rae 


system, the question of the reliability of the predicting 
equation is raised. Contrary to wnat the regression equation 
may indicate, cost and the explanatory variable may not be 
related in the same mannexz, <A particular sample could show 
such a relationship cut of pure chance when in fact none 
exists, Further, the regression equation is only one of a 
large number that could be obtained from different samples 
from within the seme population. In other words, the 


2 


predicted cost, may not be the true cost, 
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L john E., Foeund; Elementary Business Statistics, 
@enelewood Cliffs,eN.J.: Prentiss-Hail, Inc. , qe wane De "347 


2 ethods Ms wl eve@luating the reliability of certain data 
within established or theoretical Limits exists. Examples of 
such techniques include the theories of probability and 
Sormehadeon, Itwas not within the scope of this paper to 
elaborate upon these techniques, Theoretical presentations 
Of tia Materazal are made by W. A. Spurr and C. PP. Bonin, 





Ihe Relationship of Cost Estimating 
Uncertainties to Cost Qverrun 


From a discussion of cost estimating by Industrial 
Enesincering Techniques, “Analogy wor Statisovte. ween tiing 


is evident, Whatever problems may be inherent to each 


tneir effectiveness, ‘The question is: To what degree does 
uncertainty in cost estimation influence the final cost of 

the system? Experience during the 1950's showed that there 
was often a large difference between original estimates and 


the final costs of a number of weapons systems, The Depart- 


9 


ment of Defense began Looking at case histories of major 

eapons systems in an attempt to identify the reasons for 
the discrepancies, In particular, the Department wanted 

to know if the reasons for the cost overruns were bad 
Metmmating, or some other factor. 

Table 6 lists ]6 aircraft and 6 missles developed 
error to 1958 along with the ratio of actual cost to initial 
estimate, ‘the ratio is shown as the factor increase, The 
Main point of interest is tne reason for these increases 


and, specifically, if they are due to bad estimating. A 


study of the development histories of the equipment shown 
P 
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Statistical Analysis for Business Decisions, (Homewood, I11.: 
R. D, Irwin, Inc., 1967) and John E, Freund, Elementary 
Business ss Statistics, (Englewood Cliffs, N.J.: Prentiss- 
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TABLE 6 


FACIOR INCREASES OF THE 


Fignter 
Fighter 
Fighter 
Fighter 
Fighter 
Fighter 
Fighter 
Pighter 
Fighter 


Bomber 
Bomber 
Bomber 


Cargo 

Cargo 
Cargo 
Cargo 


iMmassle 
Missle 
Missle 
Missle 
Missle 
Miss fe 
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in Table 5 was made in an attempt to answer this question, 
The study led tomthe followings conclusions, 


When early estimates are made of what it 
to produce or develop something now, tne @6t 
typically bases his estimate on the current cs 
the currently plenned program for development, If he 
iS estimating cost of production, he gets a 
by costing the various components as present 
ceived and aggregating those, If he is estin 
Cost of development, Me ecStimates ine. cost of Gece 
@rticles, enSineering man-hours, etc., aS prestntiy 
planned and aggregates those. He does not speciry 
wnat performance he iS associating with the particular 
design nor does he indicate the date at which this 
performance is to be operationally available, 1@ is 

cal configuration and/or the 
physical resources contemplated in the current 
development plan, 


As develcpment proceeds, however, these initial 
designs and plans are almost invariably changed, 


u 
that forestall meeting performance requirements, or 
because the customer decides it is essential that 
the equipment ba modified so as to keep pace with 
changing predictions of enemy capabilities, new 
operational concepts, and new technological 
possibilities, 


. . . In principle it would be possible to factor 
into two parts the total error in cost estimates as 
they are prepared: (1) the part due to errors in 
the costing of the configuration supplied to the 
Gost estimator (i.e., the intrinsic error Gusecst 
estimating) and (2) the part due to changes in the 
configuration as development progresses, In practice, 
it has not been possible to carry out this separation, 
HOWevcCri. LthS Or bolver that Ene “nurimoevcrewbors 
in costing a fixed configuration tend to be small 
relative to the other source of error in the costing 
of most major items of military equipment, ~* 


In other words, of the two types of error listed 


above, requirements uncertainty is generally held to be 
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la. W. Marshail and W, H, Meckling, Predictability 
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of the Costs, Time, and Success of Development, P-1821 
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(Santa Monica: The Rand Corporation, December 1959) 
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responsible for the major portion of the factor increases, 
in order to Minimize requirements uncertainty, the Departmenc 
of Defense has introduced the Contract Definition Phase (CDP) 


for major defense contracts, <A rigorous definition of 


Requirements prior to contractor selection is intended to 


] 


reduce this type of uncertainty in the future, 
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CHAPTER LV 


AN EXAMINATION OF ECONOMIC TRENDS AND 


THeih BRELATPONS HIPS TO COST OVERRUR 


In a rebuttal to Congressional criticism of C-5A 
@eet ovemeins, Lockheed A@ecraft's president, A. C. Kotchian, 
aa —— ms | — l 
cited ecconomic inflation es the major cause, He did not 


State the specific ‘perc facter of the total overrun 


O 
D 
3 
ey 
8) 

ay 
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Mee was attributable to inflation. More récently, the 
amount of overrun on the C-5A prograin attributable to in- 
flation has been stated to be approximately S$62/ million, 
me tit time, the total overrun was estumated to betapproxi-} 
mately $1.3 billion. If the $627 million estimate were 
correct, inflation would be responsible for 48 percent of 
the overrun, 
On the other hand, Scherer classifies inflation as 
a minor factor, in the C~5A case, In prepared testimony 
hee the Subcommittee on Economy in Government, he stated: 
Economy-wide inflation has been a contributing 
factor (to cost overrun) in the Last few years, 
although it is a little hard to take Seriously, 


claims that much of the C-5A's 64 percent (of 
target price overrun is attributable to this cause 
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lithe Inflated Case of the C-5A," Armed Forces 
Management, July, 1969, p. /1 





2Harold B. Meyers, "For Lockheed, Everything's Coming 
Up Unk-Unks," Fortune Maszazine, August 1, 1969, p. 7/7 
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when the whcelesale price index for metals end metal 
products roce by only Ill percent between 1960 and 


[96e. 


Ke) 
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With the C-35A, as well as with other systems acquired 
in the past, there iS a conSiderable difference of jopinion 
concerning the contribution of inflation to cost overrun, 

It appears to be somewhat difficult to specifically 
1solate tne exact amount of inilation induced cost overrun, 
This seems to be particularly true with large systems 
acquisition where the total price may exceed $1 billion. 


@ « 


Specifications charis seéS and uncertainties tend to lead to 


4 


higher costs and fu er tend to ovscure the portion of over 
run which may be due to economic reasons, For that reason, 
EQis discussion will examine economic trends, rather than 

seek an exact overrun inflationary factor. To complete this 
task, a presentation of U.S. economic trends 1s made, followed 


% 


by an examination of some specific indicators which may show 
merelation to cost overrun. Finally, an examination of Some 
Meeent overcun cases; in an attempt to determine intuitively 


ii the amount of overrun has conformed to the economic 


gcowth trend, 
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Ly, S, vongsress, Joint Economic Committee, Ine wie? 
Budget and Seeenowe . eeanonee Priorities, Hearings, beforera 
Subcommittee on Economy in Government, 9lst Congress, Ist Sess., 
1969, pp. 379-383 
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United States Economic Trends (1958-1969) 

Beginning in 1958, the United States enjoyed both 
price stability and an expanding economy. Until 1965, prices 
had been essentially unchanged, Labor costs had barely moved, 
as gains in productivity had largely offset moderate increases 
saeuourly Labor oc Ce tne economic expansion continued 
through 1965 without the presence of significant inflation. 

By December of 1965, the unemployment rate had decreased to 
4&1 percent, This rate was just slightly higher than the 

& percent interim goal set by the Kennedy Administration in 
1962, The U.S, economy had practically achieved full employ~ 
ment, Full employment was finally reached in 19656, with a 

13 year low unemployment rate of 3.9 percent,> 

In 1964 and 1965, expansionary tax policies had 
Stimulated the economy and brought a strong increase in total 
demand, Added to this was additional Vietnam expenditures 


which made their first impact on the economy in 1966, marking 


Bre Ee a ee ee 
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lL economic hepere ef the Presiden. terpeeier ern 
the Annual Report of the Council of Economic Advisors, January 
HO66, (Washington, D.C.: Government Printing Office, 1966), p. 3/7 


“nisl, yay 2 
3Economic Report of the President, together with the 


Annual Report of the Council of Economic Advisors, January 
1967 (Washington, D.C.: Government Printing Office, 1967) p. 37 
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turning point in real conomic m@rowte, These factors bron ie 
a shift away from price stability. | The price increases were 
due in Large measure to the acceleration in the growth of 

demand which began in mid-1965, and to the particularly rapid 


Li 


macre mse “in output of capital toods and defens 
(on) 


yy 


e products, 
Demand had been rising since J961, but tnat had been during 
a period wnen there was an abundant supply of labor and 
unused eguipment, 


The sharp rise in demand for defense products and 


“ 


Capital goods imposed special pressures on the metals and 
machinery industries, In some branches of these industries, 
ere Limits of efficient Cee cetes were surpassed, Ina 
few, output was close to the absolute Limitations on 
; 3 

capacity. 

fhere were also imbalances in the labor markets 
$hich created increasing difficulties as unemployment 
declined, Workers in low paid cccupations could not be with- 
out substantial upward adjustments in wage scales, Wages 
began to rise faster at a time when productivity began to 
Slow down. 

President Johnson Summarized the reasons for tne 
upward pressure on prices in his Economic Report: 

Price rises can be traced to imbalances created by 


the special pressures of Vietnam procureinent and booming 
private investment. The spurt of demand . . . simply 
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lipid., p. 29 “Ibid. , p. 73 
3ibid., p. 73 JTlpd. - jue 
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exceeded the speed limits of the Economy's ability 

to adjust. Some price advance was the inevitable cos 
of the adjustments required in recovering from a 

Gecade of slack. Wages had to be raised sharply in 
underpaid occupations wrhicn previously held their labor 
only beacause the alternative was no job at all. Pro- 
ducers in once stagnent, low profit ingustimes  eeay 
opportunities for expansion and found 1t possible to 
raise prices and earnings in order to attract needed 
capital. Demand pressed harder on skilled occupations 
end professional services where we had trained too few 
persons to meet the needs of a hish employment economy. 
come price increases would have still occurred had 

we moved at a Steadier pace, But these price increases 
could have come slowly enough and have been small 
enough not to threaten 4a chéein reaction of wages 
chasing other wages ~ wages chasing prices + prices 
Giasing Wages ~send prrees enacting other prices: 


Zhis period marked the end of real growth and overall 


economic stability. President Nixon, in a backward Look at 


Z 
Pets periloa, commented: 


° e e <p 
“Int lation was in full tide." 


Through 1967/7 and 1968, inflation continued unabated, 


By the first half of 1969, the rate of price increase reached 
5,2 percent, the largest rate of growth since the Korean War.> 
In the second half of 1969, the rate of increase had subsided 
fore,/ percent, This shift in the rate of price increase 
Signalied a possible cownturn in the economy, The slowdown 


was most likely in response to contractionary fiscal and 


monetary policies applied commencing in 1967,4 


lIbid., pp. 5-6 


Fr conomic heport of the President, together @uvith the 
Annual Report of the Council of Economic Advisors, February 19/0, 
(Washington, D.C,: Government Printing Office, 19/70), p. 6 


3h bid, , pac? : “Thid, ; p. 30 
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Specific Economic Indicators (1958-1969) 
In @xeilaning some Specific economic trends Spo tene) ap. 


ttention is given to labor, whotesale and consumer prices, 


ns 


1958 is used as the base year. 

Labor prices remained at a fairly stable rate of growth 
from 1958 through 1965, During that period, the average annual 
hourly increase was 6,5 cents. By the end of 1965, an 
accelerated upward trend became apparent, In 1969, hourly 
earnings were increasing at a rate of 27,0 cents annually, 
Average wages ranged from $2.1) in 1956 to $3526 in Woe. 
Figure 2 lists the average prevailing hourly wage in the 
manufacturing industry by year, and graphically illustrates 
the accelerating growth rate from 1965 through 1969, 

The wholesale price index followed approximately 
the same trend as labor from 1958 to 1964, That is, there 
ieee Stable trend through that period. After that, there 
was a rapidly increasing upward tendency through 1969, There 
appears to be slight differences in the behavior of prices 
for machinery and those for metal and metal products, The 
price index for metal and metal products began a rapid growth 
rate in 1963, two years earlier than the seneral accelerating 


growth rate for machinery, Figure 3 lists the wholesale 
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FIG RE 2 


AVERAGE HOURLY EARNINGS IN MAN 
INDUSTRIES (1968-1959 
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Adapted from the Statistical Abstract of 
tie Unated Staveceml Co. (vachins ton alam 
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WHOLESALE PRICE INDEX (1958-1969) 
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Year (1958-1969) 
Source: Adapted from the Statistical Abstract of the 


United States, 1969 (Washington: Government 
Farmieine Oferce, 1969) 


price index for 1958 through 1969, Additionally, the indexes 
for metals and inachinery are comparatively displayed, The 
trends are illustrated graphically.. 

The consumer price index for the same period is listed 
and iliustrated graphically in Fisure 4, The accelerating 
growth in prices between 1965 and 1969 is obvious, 

Two Significant features of the price data contained 
in Figures 2, 3, and 4 relate to the time frame, For purposes 
G6f analysis, the periods 1958 through 1965, and from 1965 
Miiemeatter, are of pare iene Imterest, Consumer, wnholesaic., 


and labor prices during the first period increased at almost 


go; 


a constant rate, Price aS a function of time could be 
approximated by a relation of the form: 
y= aera 

Wnile it is true that the data do not exactly match the func~ 
Mmeewetne least squares line of best fit would result in a 
very small amount of dispersion, * 

The pericd after 1965 presents a different trend, 
Price as a function of time during that period could best be 


described by the equation: 


An empirical examination of Figures 2, 3, and 4 would tend 


to verify these relationships, 


ome, 








lone computational aspects of fitting data with a 
east sqwaces lage 15s covered: by John E. Faeund, Llememiary 
PecsM@e ss Steitisbiics, (Englewood Cliffs, N.J.: Prentiss-Neali, 
mre, , 1964), p. 304 
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The linear and exponential economic trends just 
described would suggest some effect on contract price out- 
comes. Contracts negotiated prior to 1965 and completed 
subsequent to 1966 might tend to be affected to tne greatest 
degree, The rationale for this tendency is set forth in the 
following, paragraph. 

Contracts for weapons systems procurement normally 
take into account the length of time involved to complete 
the task. Further, allowances are made for increases in the 
prices of labor snewieer vais based on the best estimates of 
econonie crends, | Projections based on economic performance 
prmor to 1965 would appear to meen no particular troubhe 
provided that this trend remained ‘in effect. For projections 
made for periods after 1965, based on previous experience, 
Secost overrcunefactor due to inflationary pressures seems 


to be involved, For exumple, the everage price of labor in 


$3 


pproximately 2 percent 


A 


mManuLacturing industries increased 
per year from 1958 to 1965, Assume that a contract negotiated 
in January 1964 included labor expected to cost $1 million in 
1964 prices, Further assume, that the task required by the 
terms of the contract will be completed in December 1969 


with labor effort to be divided evenly over the period of the 


Oo eee ee ee | me ee Ee Qe SE 


luis, Congress, Joint Economic Committee, Military 
Budget _and National Economic Priorities, Hearings, Op. Cit., 
mo, oCOY 





1 ; : ‘ ‘ ; 
contract,” The final assumption is that the economy will 
continue in a stable fashion, and that the cost of Labor 
should increase at a rate of approximately 2 percent annually. 

3 


Based on these assumptions, the projected Labor 


costs should approximate $],08/,8/9 for the term of the 


contract. If the contract target price allowed for this 


projected cost growtn, the final cost should appreximate 


si 


the target price, No cost overrun is involved, even though 
costs are rising. Should labor price not follow a stable 

trend, as shown in Figure 2, the cost of Labor in this con- 
tract would amount to approximately $1,114,253. Instead of 
a stable 2 percent Labor cost inerease per year, the ectual 


merease for 1956 through 1969, was 4, 5, 7, and 9 percent 


j-*- 


respectively, The difference in cost is $62,901, This 


Cost Overrun due tO abnormal 


hy 


difference is the portion o 
economic escalation, ox inflation, It is noted that the 
overrun amounts to approximately 5,9 percent of the Labor 
target price, over the entire contract period, Table / 
compares these two rates of price increase over the contract 
period, 

Application of this example to metal and material 


price changes would yield Similar trends, The actual 
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linis assumption is made for illustrative purcposes 
only. in practice, labor intensity would tend to vary con-~ 
Siderably over the contract period depending on the stage of 
fae contract, (i 2, R&D, Production, etc. ). 
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TABLE 7 


EPPFECT OF NETeerl ONMON es 
HYPOTHETICAL CONTRACT 
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1966 2 1/3 Fao a) L/6.600 
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1966 | 2 180,405 | / Poe, 635 
1969 2 184,013 a 3, 216 oe 
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Actual Labor Cost SelillGag2ss 
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wholesale price index, however ranged from 100,4 in 1958 to 
115.1 in 1969, This suggests that the percentage of overrun 
due to inflation would tend to be smaller for materials than 
labor, The rate of increase was not as great, 

The foregoing example assumed a well defined product 
with no change during tne contract period. With complex 
weapons systems, numerous changes and uncertainties aa to 
the difficulty in isolating the exact factor of overrun 
due to abnormal economic trends, Nevertheless, the factor 
would appear To be somewhat smaller than stated by the Lock- 
heed Corporation, Scherer conceded that simple economic 
inflation was surely a contributing factor to cost overrun, 
but that it was a relatively minor matter, | 

Influence of Inflation on Recent 
systems Procurement 

The following section is devoted to an examination 
of some recent systems acquisitions, Each involve a substan~ 
tial cost overrun, The causes of the overrun have been 
roughly approximated in each case, 

Meee li avionics System for Felll 

Estimates of tne cost of the Mark II system have 

reflected a steauy and substantial rate of increase since 


Autonetics was selected as the contractor in June 1966, The 


following figures indicate the size of this increase: 


owe ee ee ae ee ee 
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luis, Congress, Joint Economic Committee, "Military Budget 
Pact Lon EcOnomics rriOritves, Op, wCrt,, Pp. ov 
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(Mark II Dollar Amounts in Millions) 


a ee 
Wate of Estimate = Rose. | eee f SoG eam 
June 1966 $ 100 $ 500 600 
Decerber 1966 190 600 790 
June 1967 290 820 aL O 
January 1968 330 1,180 1 1,510 





These estimates were prepared by the contractor, 

The cost overruns in this case were attributed to 
numerous design changes made by Autoneties and the Government, 
Beers Significant rhe t inflation was not considered a major 
factor, even though these substantial increases took place 


4 e 


in @ périod of sharply rising prices, Further, Autonetics 

claimed that price increases could not be identified with 

any specific change. in its Cost Traceability Report, 

subnitted on October 2, 195/, Autonetics stated that: 

Because of the complex interrelationships of the 

activities and changes during the period June 1966 to 
April 1967, it is not possible to,estimate the cost 
effect of cach individual cnange., 


An Aix Force Cost Trace Team, in April 1968, analyzed 


ate 


the Mark II cost increases, Government cnanges in design 
were claimed to be responsible for $20.2 million. The 
remainder was deemed caused by contractor design changes, 

and poor in-house cost control, Although materials and labor 


price increases were contributing factors in part, they were 
aS 


not censidered major Ltems, 
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As stated previously, the procurement of Lockheed's 


C-5A transport has been subjected to apparently large over- 


() 


runs, The base price was stated to be $3.4 billion, with the 
ultimate price reaching approximately $5,4 billion. This 
figure is the subject of some dispute in recent months, Not 
cnly is the amount of overrun questioned, but the factors 
constituting the overrun appear to be in doubt, The following 
estimates were mace in November ]968, py the Department of 

mae Air Force, Me. AE. Fitzgerald, and Assistant Secretary 


eeeies:: 
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The estimates of overrun due to inflation also varied 
considerably, Meyers attributed $627 million to infl 
The Air Force and Fitzgerald cite $500 million and $204 m 
mespectively, as the inflationary portion of the overrun, 
Senator Prcoxmire considers inflation to be less Significant 


than alleged, and has stated: 


ine 
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3u.s, COneress Joint Economic Committee, “Mau. 
Budget and National Economic Priorities, Hearings," Op, Cit., 
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CHAPTER V 
CONCLUSIONS 
The Factors of Cost Overrun 


The examination of Government contracting methods, 
cost estimating tcols, and economic events, tends to support 
the assertion thut factors leading to cost overrun pervade 
the weapons acquisition preecess, Apparent overrun factors 
Smersed in the discussion of each broad area. In some cases, 
the factors appearcd to be interrelated with tendencies 
femecnaent on tw or wore of the ameas discussed, However, 

in most instances, the problem revolves around uncertainty 
or optimism, This discussion will recapitulate the broad 


sections previously examined, and draw out the factors that 


seem to result in the overrun problen, 


Overruy Factors in Government Contracting 

In contracting, two factors appear to stand out as 
Being, the chief contributors to cost overrun, These are the 
Renaecney for contractors to attempt to "buy-in" on a program, 


and technological uncertainty. 


14 





the buy-in tendencies were evidently recognized prior 
to-the 1980's, particularly with the use of “GPFPr con 12ce-. 
oubstitution of a larger percentage of incentive contracts 
and firmefixed price contracts apparently failed to stop 
this practice, The Fitzgerald and Murphy testimony seem to 


t~ 


CG Ret surtficrvent Gvidence 1S available to shave cia: 


jodie 


na 


joe 


ca 
the practice was used by Autonetics and Lockheed. Similarly, 
it may be a reasonable assumption to state that it was used 
in some of tne oct. studied by Marshall and Mecklin 
Likewise; other systems would not tend to be immune fron 
contracter buy-in, It wes Congressional concern that caused 
the apparent buy-in to be recosnizeds, in the case of tne 
Ceo4 and Mark I1. If the buy-in commonly exists, it may go 
unnoticed in numerous other systems acquisitions, 
Technological uncertainty has bcen an overrun factor 
in the past, From the evidence, it appears that difficulty 
will be encountered in the future with systems acquisition, 
As an overrun factor, technological uncertainty could be 
classified as one which might never be adequately guantified., 
Gmat is to say, its existence is recognized and somewnat 
taken for granted, but it is likely to remain the greatest 
difficulty to realistic target establishment, In air Systems 


procurement, the degree of departure from designs used in 


weet Syeccns tend to result in greatest dispersion Gr Ceses 
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ates from the true cost, Provided that past perfiermai 
data can be utilized in new systems, the experience could 
result in a narrower and more accurate Speculation on the 
fa@al cost, As Schultze pointed out: increased complexity, 
enorally yields increased uncertainty. The uncertainty 
in turn, tends to drive costs to a point many times what 
was experienced in the past, With technology advancing 
constantly, it misht be inferred that margins of error could 


become Larger At this point, however, evidence does not 


Support that contention, Since cost expsiience on major 
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been largely erratic, 

The Marshall and Meckling studies seem to point out 
ne trend, Overrun factors in gencral were Larger in more 
complex systems, sucn as fighters and missles, They tended 

to become smaller in less sophisticated aircraft, such as 
transports This trend appears to indicate a higher overrun 
with greater complexity. There is however, no definite 
relationship that can be stated from the evidence, that can 
be quantified, 

A conclusion can be drawn from the relation of 
technological uncertainty to cost outcome, Uncertainty 
seems to cause initial cost estimates to vary the greatest 
degree from final cost. As system development progresses 


the degree of error should become smaller, approaching zero 





as the systempeapproaches completion. IlItmdées neéteapeede 
that the technoiogicel portion of uncertemntyecan bes caeu2= 
fseantly cedueedei na future. systems ueelor this reasem a. 
eculd continually be the primary cost overrun factor 
Government contracting methods per se, would not 
appear to be responsible for overrunning the estimates, 
Generally, in a@ situation of Little uncertainty, however, 
the firmefixed price contract may he the most desirable 
to employ. On the other hand, where uncertainty is greater, 
€G@st control incen ees might be attached, For their part 
in the acquisition process, the contract may merely provide 
an environment in which cost overrun can take place, CPIr 
tends to provide the best environment while FFP, the worst. 
The ema cive contracts could supply a varying environment, 
depending on how well cost controls are applied to the 


mecccss,,and how effectively the "buy-in" tendency is controlled. 


Overrun Factors in Cost Estimating Methods 
industrial Engineering Methods.--This method of cost 
stimating appears to be of most value where a clearly defined 
System is to be produced, Since each task from the lowest 
level of detail must be analyzed and aggregated, the inference 


is that industrial engineering could be best employed when 


Gevelopment is fairly advanced. In the typical modern 
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weapons System, industrial engineering would tend to be subject 


* 


to subscquent changes in design and performance specificetions. 


Therefore, in eariy Stages of the system acquisitiony indus- 


rH 


trial engineering would not be of significant value in 
developing the initial systems cost estimates, except for 
Gupliecation of components. Contractors tend to avoi@ this 
method, 

ltw@ould tend tse Wecwmc an SvVernin Packer if soleiy 
einployed in the face of imminent technological change, 
simLlarly, Lt could PLewPeS as an overrun factor gm a Situation 
weere the wnobe turns out to be greater than the parts, as 
noted by Large. 

Estinating by Analozy.--1to employ analogy as a 
primary estimating tool, runs the risk as experienced by 


5 neat Simivaraties with past systems 


8 


Douglas, In scine c 


pad) 


Se 
may produce an excejJlent cost estimate, However, unknowns 
and technological change entering the proposed system could 
greatly reduce the value of the analogy method and introduce 
great exccor, Jt could not be termed as inherently possessing 
the tendency to produce an overrun, It must depend on the 
particular circumstances and prior data base of the estimate, 

Statistical Vechnigue,-~-Tthe danger is always present 
that data may not be related to a particular system. If 


there is rio direct relationship, this estimating technique 
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could become a cest overrun facter of varying dimensions, 
Freund's admonition that any projection of past experience 
to the uncertain future is speculative and hazardous, is 
well taken, 


fd ats — RA oe ba = a. oe s = e 
Cost Estimatins Methods in General,~--~As with the 
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goveciirent contract, any estimating technique is influenced 


by the uncertainties of technology, time, and economic 


3 


factors, Whether it is industrial engincering, analogy, or 


Yese 


Statistical, the method can be an overrun factor only to 
the extent that ener nce Ltself is faulty. Marshall an 
eekling concede thateat isenot possible, im practice, to 
isclate the extent of the Ec! cost estimating error, 
ieeelarxon to other factors, such*as buy-in, estimating 
techniques of themselves, do not appear to be a prime 


overrun factor. 


Seereun as a function of inflation 

To examine a program such as the C-5A, inflation was 
conceded to contribute to the overrun, Yet, the range of 
estimates on exactly how much it added was great, These 
ranged from $204 million to $627 million. Such a range 
seems to indicate that the inflation overrun factor is not 
really identifiable, Eigeet ss Ceotinomy sOum ocmenes: nd 


Birtzserald tend to discount inflation as a prime factor in 





overrun, If the rate of price increase is compared to the 
Fate baSed on@eet trends, the dimferemto constitutes over= 


run, ine difference; even in periods of considerable 
inflation, such as 1966 to 1969, tends to be relatively small. 
It appears that inflation is definitely an overrun factor 

to the extent that price growth is not included in gevern- 


ment contracts, However, this does not seein to be as large 


an item as commonly supposed, 


NESS Factor Intexrelationships 
Buy-in vs, Optimi sm 


Both the Mark II and Skybolt programs resulted in 


overruns of considerable magnitude, yet the contractors were 
accused of different practices, utonetics was said to have 


tempted a buyin by submitting an apparently unrealistic 
low bid. On the other hand, Douglas made a very low bid on 
Skybolt and was thought to be overly optimistic, the 


difference between tne two appears to be difficult to 


oh 


t is possible that 1t is largely a matter of 
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Semantics, Yet, it could very well be based on the contractor 


~ 


Wee. iin order to further asolate overrun facters, it is 
inferred that the buy-in constitutes a deliberately low bid 
wnile the Douglas Skybolit case is one of optimism based on 


overambitious development attempts. The study differentiates 


between the two on that basis, 





8] 


Contracting and Estimating _ 
Although contracting and estimating were examined 
as separate entities, they seem to be closely related to 
each otner, Ihe valuG of ube contract, or wnetines or rot 
the final cost equals the expected cost, is dependent on 
the jnitial cost estimate. While estimating may possess 
gemec not too clearly defined faults of itself, it seems to 
be inseparably attached to the contracting process, The 
cost overrun factor, therefore, seems to be a tendency 
or trend that was not, or could not be applied to the 


estimating metnod. The estimating method by itself, does 


not appear to constitute a serious overrun factor, 


Gost Overrun FactoernsmSummariged 
As a result of the evidence, testimony, and cases 
Gwamined, the following factors are set forth as the 
apparent prime overrun factors: 


(1) Technological uncertainty may be the most 


Serious cauSative agent, There is Simply not a Significant 
step that can be taken to eliminate it, 


(2) An apparently strong contractor incentive to 
deliberately make a low estimate in order to buy-in on a 
progrem., 


(3) The wptimisin that pervades initial program 
@@ex%Sion waking, with a resubting unrealistically low 
Gentraer bid, 


(4) Simple economic inflation; and probably the 
least serious of any overrun factor, 
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Application of Overrun Factors 
to the Estimating Process 


Thres cf four overrun factors cited are of @ hzgnly 
intangible nature, Buy-in and optimistic tendencies seem 
te be largely subjective and not readily adaptable to 
quantification. Technological uncertainty is an unknown 

Gf vaiying degrees, 

Mas study has uncovered no relationships, ¢Gither 
expressed or inferred, that would tend to show that overrun 
fectors could eventually be applied to the estimatin 
process, ; 

Hae Loui Lactos, ani lacion.) is in theory capable 
See onteme pressed in concrete terms, However, LUSecsrpile 
interaction with the other factors: make it extremely diffi- 
cult to isolate, Apparently, general trends can be, 


demonstrated, but exact definitions shall probably remain 


a part of the unknown, 


Conclusion 
Cgct OVerriin, as a aelinite factor in Sycten acquis tuic. 
has apparently been greatly oversimplified. Critics seem 
especially ready to cite the original cost estimate and 
compare this to the final system cost. The difference, or 
apparent overrun, 18 attributed to a variety of reasons, 


as previously examined, However, what is often stated to be 





overrun is not really overrun. Original specifications 


¢ 9 
3) 
~<a 
0 


Ciansed, Or tie com@ept Of RS prtvrem 15 2vtewed Chanzes 
and alterations have a tendancy to change the total cost of 
the program, In other words, added program benefits can be 
equated with added increments of cost, The real cost over- 
run must he considered as the cost not associated with the 
Grance in progran scope, 

AS increasingly complex systems are developed and 
produced, cnange appears to remain a persistent byproduct 
Beeruture acquisitions, For this reason, the real cost 


overruns woien may occur, might constitute the most elusive 


element in systeins procurement, 





APPENDIX A 


DEPARTMENT OF DEFENSE INSTRUCTLON 7/000, 2 


S| 


subject: Performance Measurement for Selected Acduisitions, 


Refexences: (a) DOD Directive 7000.1, "Resource Management 

systems of the Department of Defense, 
August 22, 1966 

Cb) DOD DitectivesS 00 Cy ines cl onmet 
Engineering and Operational Systems 
Deve Lopment, # saly 1) cae 

(c) Axmed Services Procurement Regulations 
AL TGS saat san) 

(d) MIL-STD-88]1 (to be published) 


I. PURPOSE AND@ARPPLICSBILITY 


fhis Instruction sets forth objectives and criteria and 
Pechorizes the puodlication of a Buide, within the purview 

of reference (2a), for the application of uniform DOD require- 
ments fox contr ractors? management control Bia to selected 
Defense contracts, The provisions of this Instruction require 
che use of Cost/Schedule Control Systems pets CC) SCS CG) Jin 
Share eS pee and apply to all Military Departments 
end Defense Agencies (Cher ojrafter referred to as DOD Come- 

: Sich are responsible for acquisitions during engin- 
ecring development, operational systems development and 
production, 


Il. SOPE 


A. the acquisitions governed by this Instruction will be 
in selected contracts within programs which are estimated in 
the Five Year Defense Program to require (1) a total cumula- 
tive financing for Researen, Development, Test and Evaluation 
immemeesaeet $25 million or (2) See ore production invest- 
ment in excess of $100 million. Firm fixed-price contracts 
Wali be excluded. 


B,. Subcontracts within applicable programs, excluding 
imose taat awe firm Timed-price, Will Be selected for 





applieation of these criteria by mutual agreement between 
pyimes contractors gnd the contracting, VDOD Component, 
4Q®Gea@ing Go the cuhticality of the seupcontracre cto Vee 
Brocram, Covertaag or certain critical subecaneractcs may, be 
dinvected by tne DOD subject to the changes article of the 
S0QnLcracts, 


Itll. OBJZCTiVe 


A, DOD contractors should be continuously alert to 
advances being developed in management control systems to 
Lmprove their contract performance, and to sexve DOD and 
Gait Mest anterests, It 1s an objective of this Instruction 
to brine to the attention of and encourage DOD contractors 
to accept and install management control systems and procedures 
Which are most effective in meeting their requirements, 


B. fo provide an adequate basis for responsible decision 
making by both contractor management and DOD Components, 
contractors! internal management control systems must pro-~ 
vide data which (1) indicate work progress, (2) properly 
relate cost, schedule, and technical performance, (3) are 
valid, timely, and auditable, and (4) supply DOD managers 
with a practicable level of summarization, 


TVe PPOEVCY AND BiROGhoURES 
ms rolacy 


It shall be the general policy to (1) require application 
of the DOD criteria as stated in Enclosure |] to programs that 
are within the scope of Section II above, (2) require no 
changes in contractors! existing management control systems 
except those necessary to meet the criteria, and (3) require 
the contractor to use data from his own management control 
system in reports to the Government, 


B, Procedures 


Jue procedures contained herein will not be construed as 
requiring the use of specific systems, or changes in accounting 
systems which will adversely affect the equitable distribution 
6: costs to all contracts, To avoid the proliferation of 
demands on contractors for demonstrations of thoir management 
Systems, the criteria outLined in Enclosure ] shall. be incor- 
porated in a baSic agreement between the DOD and the contractor 
warerever feasible and will apply to more than one contract. 
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Hewever, agreements concernitg the a ne a and use of 
contractors! management control systems may be accomplished 
by Wee use Of sbasic agreement wom sm csuaet, separate pro- 
Surement Contracts, 


1. Basic Agreement 
ae aon use on a eee S agreeme Tae Ce ee the otc ition 


LONS Whien kane Seen an Giiceaeenaia a ae eae 
tor and the DOD of the requixements of the DOD 

ia, and (2) identify the specific system(s) which the 
ractor intends to use of applicable contracts with DOD 
Components, The basic agreement will include a written 
description of the system(s) validated in a demonstration 
review in sufficient detail to permit adequate surveillance 
by all interested parties, The use of a basic agreement in 
more Circumstances. is preferred where a number of separate 
contracts between one or more DOD Component(s) and the con- 
tractor may be entered into during the terin of the basic 
agreement, It contemplates the delegation of authority 

to the cognizant DOD Component negotiating the basic agree-~ 
ment by all othex DOD Components in order that it represent 
an understanding between the contractor and all prospective 
DOD contracting cmnaponents, The baSic agreewents will be 
entered into piu7suent to Section 3-410 of the Armed Services 
Procurement Regulation (reference (c)). 


oo Ny 
ie e me Se 
tr 


b, Action to develop a basic agreement may be initiated: 


(1) Unilaterally by “the contractem: 
(2) By a DOD Component request to the contractor; and 
(3) By either the contractor or the DOD Component, 

@s the result of a contractor's response to a Request 

for Proposal (RFP), 


c, A basic agreement tray be arrived at after evaluation 
Si the contxactor's management control system in the context 
momeme cri cetea, within the contractor's present or proposed 
operating environrent and not necessarily in response to an 
RFP, The management control system(s) identified in the 
basic agreement will also be subjected to a demonstration 
review Wine Mayeoccur wi tiin, the. Gentractor”’s” present 
environment, or in conjunction with the contractor's imple- 
mentation of ee Sepa ace POD Pprecuremelt corcract., 





S/ 


’ re Plan oN ~ "4a" "~ cr 
2. Separate Procurement Contracts 


ee ey Same Tw 


Lo 


AS a Yoesmlt @f either ths reqeaipmment nezidily pleGed in an 
RFP of @ acti#en. initiated a DOD Components, the contractor 
WiLlL pxrovide a response waich deseribes the integration of 
the basic subsystems to provide control of cost, schedule, 
ana technical performance, This involves: 


je? 


. .relhe contracting DOD Component will conduct 
fo review aS a part or normal precurement procedures to 
re tnat the systems meet established criteria, When the 
systems have been evaluated and the contract awarded, the 
Gentracting DOD Component will notify the contractor of the 
BeGu1TS. 


ee a ee - 


a Eva luatio: 
= 


Mane i 
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b. Demonstration.~--DOD personne). will conduct an in-piant 
demonstration review of the contractor's management control 
Systems, The purpose OL systems demonstrations is to vemuify 
that the contractor is operating systems which meet the 
eriferia, Upon completion of this demonstration, a written 
description of the system validated will be provided by the 

I 41 to permit adequate 


je 


Tah 


Ee 


Ge reactor in Sufficient de 
surveillance, 


3, Demonstration Teams 
a, The team conducting a demonstration review will 
Ordinarily include representatives from the Army, Navy,, Air 
Force (except where a Service requests nonparticipation due 
to noninvolvement), and the cognizant Defense Contract Audit 
Ageney (DCAA) Auditor, The contracting or cognizant DOD 
Component will provide the team leader and will be responsible 
for all matters concerning the conduct of the demonstration 
review, 


b, A detailed discussion of the team composition, tests, 
and guidance for the conduct of the review is contained in 
the Guide for Performance Measurement established under 
section VI below. 


4. Reexamination 


@. in the ee the contractor's system fails to pass the 
demonstwation review, the cognizant DOD Component will dis- 
cuss tne specific Shortecomanesmivith the conitaaactor and 
require the’ contractor to submit proposals for correcting 
deficiencies, Subsequent to offiebeal notification by the 
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cognizant DOD Component of a failure, the portion(s) of the 
management control system that failed may be subjected to a 
follow-up review, pe suidance and procedures con- 
cerning determination and resolution of failures are contained 
in the Guide for Ronee Measurement, 


b, Upon successful completion of demonstration review, 
contractors will not be subjected to re-examination (other 
than through noxmal surveillance), unless there are positive 
indications that the contrector's system no longer meets the 
SeL_terica, 


Vo Goel ONo lei tire 


The DCAA will review tne contractor's accounting system 
and determine the accuracy and reliability of the financial 
date contained in the reports prepared from the contractor's 
systems and reported data will be accomplished by the cog- 
nizant plant representative. The cognizant auditor and the 
plant represtntative will collaborate in reviewing areas of 

Jina ye inte Simes «. 


A, The surveillance reviews will consist of (1) recurring 
evaluations of the effectiveness of the contractor's policies 
and procedures to produce valid data consistent with the ine 
tent of this Instruction, and (2) selec: ive tests of reported 
data, 


B, The cognizant auditor will submit a formal report of any 
Gemmcicweies that cannot be resolved with the comtractor, 
to the contracting DOD Component(s) through the local plant 
representative, 


Vil eee Gie De 


A. The offace of the Assistant secretary of Derense 
(Comptroller) (OASD(C)) will publish, revise as necessary, 
and distribute the Guide for Per formance Measurement separately 
feom this Instruction. 


B, The OASD(C) will maintain surveillance over the 
procedures prescribed in the Guide for Performance Measurement 
and insure implementation and continuous operation in a uni- 

Seem manner throughout the Department of Defense, 


C. Until the Guide for Performance Measurement is published, 
meelsteCatton of the criteria to ongoing or proposed pregrams 
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and associated reporting requirements will be subject to prior 
approval by the Assistant Secretary of Defense (Comptroller) 
(ASD(C)) or his designee for the purpose, with the concurrence 
of the Director of Defense Research and Engineering and the 
Assistant Secretary of Defense (Installations and Logistics). 


Vite RE CiLTVE Det a See ei bon 


This Instruction is effective immediately, Two (2) copies 
of the proposed implementation documents will be forwarded to 
the ASD(C) within ninety (90) days after the date of this 
Instruction, Implemonting instructions will not be published 
Mereil tmitery es) days after their submission to ASD(c) for 
their review. 


. R, N. ANTHONY, 


Assistant Secretary of Defense (Comptroller), 
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